Methods and systems for increasing the input efficiency of personal digital assistants and other handheld stylus-engagable computing devices

ABSTRACT

Methods and systems for enhancing the input fidelity of personal digital assistants (PDAs), and other handheld stylus-engagable computing devices are described. In some embodiments, this can be done by associating input commands with different user-input activities, including different combinations of user-input activities. By using different combinations of user-input activities to designate particular input commands, a more robust collection of commands can be provided to a user in a manner that is simple, straight-forward and easy to understand.

TECHNICAL FIELD

[0001] This invention relates to methods and systems for increasing theinput efficiency of personal digital assistants and other handheldstylus-engagable computing devices.

BACKGROUND

[0002] With the increased mobility of people in today's workforce, thedemand for mobile computing and communication capabilities outside ofthe office has also increased. Those inside the office, as well as thosewho typically work outside the office such as salespeople and fieldprofessionals, often require the ability to communicate with others andaccess various data files. In response to this demand, handheldcomputing devices such as personal digital assistants (PDAs) have beendeveloped.

[0003] A PDA is a compact device that can serve various functionsincluding a cellular phone, facsimile transmitter, personal organizer,and the like. PDAs typically include a stylus and a touch screen foruser input, and may include a keyboard. PDAs can be used for such thingsas sending and retrieving e-mail, Web browsing, and data-sharingapplications over the Internet, intranet or corporate networks.

[0004]FIG. 1 shows an exemplary PDA 100 including a stylus 102. PDA 100includes a housing 104 that defines a display area 106 that supports atouch screen 108. Various user-engagable buttons 110 are provided andenable a user to interact with the PDA. To interact with the PDA, theuser can either use buttons 110 to make various menu selections that aredisplayed on the touch screen 108, or they can use stylus 102 tophysically engage the touch screen.

[0005] Because of the compact nature of PDAs, there are some fundamentalissues that have evolved with respect to their input efficiency.Specifically, the input fidelity in PDAs is typically very low. There isa stylus that will allow a user to touch on various places on thescreen. There typically is not a keyboard per se, so if a user wishes toenter a large volume of information rapidly, they really don't have thatcapability.

[0006] There have been attempts in the past directed to solving theinput fidelity issues regarding PDAs.

[0007] One such attempt provides character recognition technologywhereby a user can write on the touch screen using the stylus, or have asmall keyboard pop up on the display that can then be used totouch-select letters. This attempt can be slow and cumbersome. Forexample, due to the small screen real estate area, it is ofteninconvenient and difficult to write large amounts of information on thetouch screen. In addition, the small screen real estate can adverselyaffect the visual resolution of the displayed keyboard, thus makinginput activities more difficult.

[0008] Another attempt to solve the input fidelity issues regarding PDAsplaces a large number of buttons on the PDA and/or screen for the userto engage. This attempt is limited by the form factor or size of thePDA. Consider again FIG. 1. There simply is not a great deal of spaceavailable to accommodate a large number of additional buttons.

[0009] Yet another attempt to solve the input fidelity issues regardingPDAs provides a “drill down” functionality that allows a user to drilldown to various lower level menus which, in turn, display additional anddifferent menu options. One way of doing this is to have the stylusphysically engage the screen for a predetermined time period (e.g. 3seconds), whereupon a second menu can pop up and be displayed. Thisattempt requires extra time and effort on the user's part to drill downthrough the various menus. In addition, this attempt can be confusing touse and can result in the user following unintended menu branches. Thisdrill down problem is similar to the drill down problem that exists incells phones having drill down capabilities. Anyone who has everattempted to use the drill down capabilities in a cell phone hasprobably experienced at least one unintended frolic through menuselections that they were not looking for.

[0010] Accordingly, this invention arose out of concerns associated withimproving the input fidelity of personal digital assistants (PDAs) andother handheld computing devices.

SUMMARY

[0011] Methods and systems for enhancing the input fidelity of personaldigital assistants (PDAs), and other hand-held, stylus-engagablecomputing devices are described. In some embodiments, this can be doneby associating input commands with different user-input activities,including different combinations of user-input activities. By usingdifferent combinations of user-input activities to designate particularinput commands, a more robust collection of commands can be provided toa user in a manner that is simple, straight-forward and easy tounderstand.

[0012] In some embodiments, methods and systems are provided thatassociate one or more input commands for use with a stylus-engagable,hand-held computing device, with a combination of user-input activities.The computing device comprises a touch screen that is engagable with astylus. A combination of user-input activities is detected and an inputcommand is generated that is associated with the detected combination ofuser-input activities. In some embodiments, one type of user-inputactivity comprises transmitting a signal from the stylus to thehand-held computing device. The generated command is then performed.

[0013] In other embodiments, methods and systems are provided thatdisplay a selectable area on a touch screen of a hand-held computingdevice. The selectable area is touch-selectable by a stylus that isassociated with the handheld computing device. A first command isexecuted if a stylus engages the selectable area. A second differentcommand is executed if the stylus engages the selectable area and thestylus transmits a receivable signal to the personal digital assistant.

BRIEF DESCRIPTION OF THE DRAWINGS

[0014] The same numbers are used throughout the drawings to referencelike features and components.

[0015]FIG. 1 is an illustration of a personal digital assistant.

[0016]FIG. 2 is a table that illustrates certain inventive concepts inaccordance with one or more embodiments.

[0017]FIG. 3 is a flow diagram that describes steps in a method inaccordance with one embodiment.

[0018]FIG. 4 is an illustration of a personal digital assistant inaccordance with one embodiment.

[0019]FIG. 5 is an illustration of a personal digital assistant inaccordance with one embodiment.

[0020]FIG. 6 is an illustration of a personal digital assistant inaccordance with one embodiment.

[0021]FIG. 7 is an illustration of a personal digital assistant inaccordance with one embodiment.

[0022]FIG. 8 is a cross-sectional view of a portion of a stylus inaccordance with one embodiment.

[0023]FIG. 9 is a block diagram that illustrates various components of astylus and a PDA in accordance with one embodiment.

[0024]FIG. 10 is a flow diagram that describes steps in a method inaccordance with one embodiment.

DETAILED DESCRIPTION Overview

[0025] The embodiments described below can greatly enhance the inputfidelity of personal digital assistants (PDAs) and other handheldstylus-engagable computing devices. In some embodiments, this can bedone by associating input commands with different user-input activities,including different combinations of user-input activities. By usingdifferent combinations of user-input activities to designate particularinput commands, a more robust collection of commands can be provided toa user in a manner that is simple, straight-forward and easy tounderstand.

[0026] Examples of user-input activities can include engaging auser-engagable structure on the PDA, pressing a button on the PDA,touching the touch screen of the PDA with a stylus and the like. So, forexample, one input command might be given by both engaging a particularbutton on the PDA and touching a displayed item on the touch screen withthe stylus. Yet, a different input command might be given by onlyengaging the same button.

Exemplary Inventive Principles

[0027] To assist the reader in understanding and appreciating theinventive embodiments described below, the following discussion providesan explanation of various inventive principles that are embodied in atleast some of the embodiments.

[0028]FIG. 2 shows a table 200 that organizes and associates variousinput commands 202 with various user-input activities. An “X” in aparticular box for an associated command means that that particularuser-input activity is used to generate that input command. The commandsin the example are numbered “1” through “5”, while there are fourexemplary user-input activities. It is to be appreciated and understoodthat many more commands are typically organized and associated withvarious user-input activities.

[0029] As noted above, user-input activities can comprise differenttypes of activities. For purposes of this example, assume the following.User activity 1 consists of a user engaging a first button associatedwith the PDA; user activity 2 consists of a user engaging a secondbutton associated with the PDA; user activity 3 consists of a userengaging a third button associated with the PDA; and user activity 4consists of a user engaging a certain area of the PDA's touch screenwith the stylus. The engagable areas on the touch screen can bedifferent from one another.

[0030] From table 200, the following can be ascertained. When a userengages the first button and touches a particular area of the PDA'stouch screen with the stylus, command 1 is generated. A differentcommand is generated if, instead of engaging the first button andtouching the particular area of the PDA's touch screen, the user simplyonly touches the same area of the touch screen without engaging thefirst button. Similarly, when a user engages the second button andtouches a particular area of the PDA's touch screen with the stylus,command 2 is generated. The “particular area” that is touched by thestylus can be the same area or a different area from the above example.A different command is generated if, instead of engaging the secondbutton and touching the particular area of the PDA's touch screen, theuser simply only touches the same area of the touch screen withoutengaging the second button. Likewise, when a user engages the thirdbutton and touches a particular area of the PDA's touch screen with thestylus, command 3 is generated. A different command is generated if,instead of engaging the third button and touching the particular area ofthe PDA's touch screen, the user simply only touches the same area ofthe touch screen without engaging the third button. Explanation ofcommands 4 and 5 logically follow from the above discussion.

[0031]FIG. 3 is a flow diagram that describes steps in a method inaccordance with one embodiment. The steps can be implemented in anysuitable hardware, software, firmware, or combination thereof. In theillustrated example, the steps can be performed by a suitably programmedPDA. The various steps can reside as software instructions that areembodied on a readable-medium that comprises part of the PDA.

[0032] Step 300 associates one or more input commands with a combinationof user-input activities. But one example of how this can be done isgiven above in connection with FIG. 2. Specifically, user-inputactivities such as engaging a particular button and touching aparticular area of the PDA's touch screen are associated with differentcommands. Step 302 detects a combination of user-input activities. Thisstep is implemented by the PDA detecting when a user has performed acombination of user-input activities. For example, if a user were todepress a first button and engage a particular area of the PDA's touchscreen, then this step would detect that event. Specific examples of howthis can be done in various embodiments are given below.

[0033] Step 304 generates an input command associated with the detectedcombination, and step 306 performs a generated command.

[0034] As an example, consider the following in connection with FIGS. 4and 5. FIG. 4 shows a PDA 400 in which the user has called up an emailwindow 402. The PDA includes multiple buttons generally designated at404. The email window 402 contains four email messages—one from Lance,Melissa, Grace, and Max. The user has selected, by touching the touchscreen with stylus 102, the email message from Lance. This action isdetected by the PDA which then generates a command to display the emailmessage that has been selected by the user. Consider now FIG. 5. There,the FIG. 4 PDA is shown with the same email window 402 displayed for theuser. In this instance, however, the user has provided a combination ofuser-input activities. Specifically, the user has touched an emailmessage (i.e. the one from Lance) and, at the same time, has depressedthe leftmost of buttons 404 (as indicated by the shading of the leftmostbutton). In this particular example, this specific combination ofuser-input activities is mapped to a “delete” command. Accordingly, thePDA detects the combination of user-input activities (as in step 302),generates an input command associated with the detected combination (asin step 304), and performs the generated input command (as in step 306).

[0035] Another embodiment provides for common areas of the same displaywindow that is displayed on a PDA's touch screen to be mapped todifferent input commands. The PDA determines which input commands toselect based on which area has been selected or touched by the stylus,as well as which (if any) button or buttons have been depressed by theuser. Execution of multiple input commands can take place, for a giventouch screen area, in a scroll-independent manner. Specifically, a usercan access multiple input commands for a given touch screen area withouthaving to physically scroll down through various additional menus.

[0036] As an example, consider again FIGS. 4 and 5. The common area ofthe display window, in this example, is the area in which the email fromLance appears. In the FIG. 4 case, the input command that is selected bythe PDA is a “read” command which permits the user to read the emailmessage. The “read” command is associated with the single user-inputactivity of engaging the touch screen area with the stylus. In the FIG.5 case, however, the very same touch screen area for the display windowis mapped to a different input command based upon the fact that the userhas both selected or touched the area with the stylus and depressed theleftmost button.

[0037] In the above example, the PDA is configured for mapping multipleuser-input activities to different commands using buttons that arecurrently in place and which have other functionalities. Specifically,buttons 404 in FIGS. 4 and 5 can have what can be considered typicalfunctionalities that are normally associated with PDAs (i.e. selection,scrolling, and the like). When used in conjunction with the stylus,however, these buttons can take on a different character. Specifically,these buttons can now be imparted with extended functionalities which,together with the stylus, provide a user with an opportunity to beexposed to a much more robust collection of input commands for a givenPDA screen display.

First Exemplary Embodiment

[0038]FIG. 6 shows a PDA 600 in accordance with one embodiment.Reference numerals from the FIG. 1 PDA have been used except that theyhave been changed to the “600” series. For the sake of brevity,duplicative aspects of the FIG. 6 PDA are not described.

[0039] In this embodiment, PDA 600 is configured withspecially-dedicated user-engagable structures that can be used inconnection with the stylus 602, to provide the enhanced functionalitiesdescribed above. Specifically, in this example, the user-engagablestructures comprise buttons that can be depressed by the user. Exemplarybuttons are shown at 612, 614, 616, 618 (on the left side of the PDA),and 620, 622, 624, and 626 (on the right side of the PDA). Buttons neednot be provided on each side of the PDA. Specifically, a right-handedconfiguration can provide buttons only on the left side of the PDA (i.e.buttons 612-618), while a left-handed configuration can provide buttonsonly on the right side of the PDA (i.e. buttons 620-626).

[0040] Hence, in this example, buttons 612-626 can be incorporated intoa table, such as table 200 (FIG. 2) so that mappings can be defmed forthe various combinations of user-input activities that can exist.

Second Exemplary Embodiment

[0041] In the embodiment discussed above, the user-engagable structures(e.g. the buttons) that enable a user to provide the differentcombinations of user-input activities are positioned on the housing ofthe PDA. In one instance, the buttons are the typical buttons thatnormally appear on the PDA except that they now have multi-functioncapabilities. In another instance, the buttons are special purposebuttons that are specifically provided for imparting the describedcharacteristics to the PDA.

[0042] In the embodiments described below, the user engagable structuresthat enable a user to provide the different combinations of user-inputactivities are positioned on the stylus itself. This permits andpromotes one-handed operation so that a user, by using only the handthat grips the stylus, can navigate through the different combinationsof user-input activities.

[0043] Consider, for example, FIG. 7 which shows a PDA 700 in accordancewith one embodiment. Reference numerals from the FIG. 1 PDA have beenused except that they have been changed to the “700” series. For thesake of brevity, duplicative aspects of the FIG. 7 PDA are notdescribed.

[0044] Notice that stylus 702 comprises multiple user-engagablestructures positioned near the tip. In this example, the user-engagablestructures comprise buttons 712, 714, and 716. The buttons 712-716function in much the same way as the buttons described above when usedin connection with the stylus engaging the PDA's touch screen 708. Thisfunction was discussed in some detail in connection with FIG. 2 and, forthe sake of brevity, is not repeated here.

[0045] Although the user-engagable structures on the stylus function inmuch the same way as described above, in this embodiment, the stylus isconfigured in a manner which enables it to articulate to the PDA 700that the user has engaged one or more of the buttons on the stylus. Thisway, the PDA's processor can take the necessary actions to map theuser-input activities to the proper input commands and execute thosecommands.

[0046] Consider, for example, FIG. 8 which shows but one way that thearticulation process can take place. There, a cross-sectional view of aportion of stylus 702 is shown. Button 712 is spring biased by a spring(not specifically designated) that permits the button to be reciprocatedin the vertical direction as viewed in the figure. An electrical contact800 is disposed on the underside of the button. A pair of electricalcontacts 802, 804 are supported on the inside of the stylus housing.When button 712 is pressed by a user, the button moves downwardsufficient to bring contact 800 into engagement with contacts 802, 804,thus completing a circuit. When the circuit is complete, a signal can betransmitted to the PDA to inform the PDA that a particular button hasbeen depressed. Each button can correspond to a different signal so thatthe PDA knows which button on the stylus has been depressed.

[0047] As an example, consider FIG. 9 which shows stylus 702 and PDA700. Stylus 702 comprises a transmitter 900 which can be any suitabletransmitter that is capable of transmitting a signal that can bereceived by PDA 700. Examples of suitable transmitters can include,without limitation, bluetooth transmitters, radio frequency (RF)transmitters, light transmitters, infrared (IR) transmitters and thelike. As shown, each button on the stylus is represented as a switch.When the switch is closed (corresponding to a user depressing anassociated button), a circuit is formed which permits the transmitter900 to produce a signal which is then transmitted to the PDA 700. Asnoted above, each button can be associated with a different signal sothat the PDA knows which button has been depressed.

[0048] PDA 700 comprises, in this example, a receiver 902 which can beany suitable receiver that is capable of receiving a signal generatedand transmitted by transmitter 900. Examples of suitable receivers caninclude, without limitation, bluetooth receivers, radio frequency (RF)receivers, light receivers, infrared (IR) receivers and the like. PDA700 also includes a processor 904 and storage 906. Storage 906 containssoftware instructions that are executed on processor 904 for generatingand performing input commands that correspond to the user-inputactivities that are provided by the user.

[0049]FIG. 10 is a flow diagram that describes steps in a method inaccordance with one embodiment. The method can be implemented in anysuitable hardware, software, firmware, or combination thereof. In theillustrated example, the method is implemented by a suitably programmedPDA such as PDA 700 in FIG. 9.

[0050] Step 1000 starts the method and step 1002 determines whether astylus has engaged the touch screen. This step can be performed usingtechniques that are well known in the PDA art. If the stylus has notengaged the touch screen, the method loops back to step 1002 and waitsuntil the stylus has engaged the touch screen. If the stylus has engagedthe touch screen, step 1004 determines whether one or more buttons onthe stylus have been depressed by the user. This step can be implementedin any suitable way. Examples of how this can be done are described inconnection with FIGS. 8 and 9 above. If a button has not been depressedby the user, step 1006 executes a first command. This step isimplemented by the PDA's processor. If, on the other hand, a button isdepressed on the stylus, step 1008 executes a second command which isdifferent from the first command.

[0051] It is to be appreciated and understood that steps 1002 and 1004need not be performed in the illustrated order. Specifically, the methodcould first detect that a button on the stylus has been depressed, andthen wait for the stylus to engage the touch screen in order to executethe second command.

[0052] It is to be appreciated and understood that the above-describedstylus can transmit a signal to the PDA using any suitable transmissionmedium. For example, the stylus can include a wire that is connectedbetween it and the PDA. Accordingly, the signal can then be transmittedvia the wire. In addition, the signal can be transmitted to the PDA inthe way that the stylus physically engages the touch screen.Specifically, the stylus can be specially configured to engage the touchscreen in a first way when a button is not depressed. This first way caninvolve fitting the stylus with a first type of tip. When a button isdepressed, the tip configuration of the stylus can be changed to asecond type of tip that physically engages the touch screen in adifferent, yet perceptible manner.

Conclusion

[0053] The embodiments described above can greatly enhance the inputfidelity of personal digital assistants (PDAs) and other handheld,stylus-engagable computing devices. In some embodiments, this can bedone by associating input commands with different user-input activities,including different combinations of user-input activities. By usingdifferent combinations of user-input activities to designate particularinput commands, a more robust collection of commands can be provided toa user in a manner that is simple, straight-forward and easy tounderstand.

[0054] Although the invention has been described in language specific tostructural features and/or methodological steps, it is to be understoodthat the invention defined in the appended claims is not necessarilylimited to the specific features or steps described. Rather, thespecific features and steps are disclosed as preferred forms ofimplementing the claimed invention.

We claim:
 1. A method of operating a stylus-engagable, hand-heldcomputing device, the method comprising: associating one or more inputcommands for use with a stylus-engagable, hand-held computing device,with a combination of user-input activities, the computing devicecomprising a touch screen that is engagable with a stylus; transmittinga signal from the stylus to the hand-held computing device, saidtransmitting comprising a first type of user-input activity; detecting,in combination with said first type of user-input activity, at least oneother type of user-input activity; generating an input command that isassociated with the detected combination of user-input activities; andperforming the generated command.
 2. The method of claim 1, wherein saidtransmitting is performed responsive to a user engaging a button on thestylus.
 3. The method of claim 1, wherein said transmitting is performedresponsive to a user engaging multiple buttons on the stylus.
 4. Themethod of claim 1, wherein said at least one other type of user-inputactivity comprises touching the computing device's touch screen with thestylus.
 5. One or more computer-readable media having computer-readableinstructions thereon which, when executed by one or more processors on astylus-engagable, hand-held computing device having a touch screen,cause the one or more processors to: detect a combination of user-inputactivities, the combination being associated with an input command, theuser-input activities comprising (1) engaging a button on the stylus,and (2) touching the computing device's touch screen with the stylus;generate the input command that is associated with the detectedcombination of user-input activities; and perform the generated command.6. A personal digital assistant comprising the computer-readable mediaof claim
 5. 7. A personal digital assistant comprising: a stylus havingone or more user-depressible buttons; a stylus-engagable touch screen;one or more processors; one or more computer-readable media; anassociation embodied on the readable media, the association definingrelationships between one or more input commands and a combination ofuser-input activities associated with individual input commands; andcomputer-readable instructions on the readable media which, whenexecuted by the one or more processors, cause the one or more processorsto: detect a combination of user-input activities, one user-inputactivity comprising touching the touch screen with the stylus; generatean input command that is associated with the detected combination ofuser-input activities; and perform the generated command.
 8. Thepersonal digital assistant of claim 7, wherein the instructions causethe one or more processors to detect a user-input activity thatcomprises depressing a button on the stylus.
 9. A method of operating astylus-engagable personal digital assistant, the method comprising:displaying a selectable area on a touch screen of a personal digitalassistant, said area being touch-selectable by a stylus associated withthe personal digital assistant; executing a first command if a stylusengages the selectable area; and executing a second different command ifthe stylus engages the selectable area and the stylus transmits areceivable signal to the personal digital assistant.
 10. The method ofclaim 9, wherein said executing of the second different commandcomprises doing so responsive, in part, to a user engaging one or morebuttons on the stylus to cause the stylus to transmit the receivablesignal.
 11. The method of claim 9, wherein said executing of the seconddifferent command comprises doing so responsive, in part, to the stylustransmitting a signal via a bluetooth transmitter.
 12. The method ofclaim 9, wherein said executing of the second different commandcomprises doing so responsive, in part, to the stylus transmitting asignal via a radio frequency (RF) transmitter.
 13. The method of claim9, wherein said executing of the second different command comprisesdoing so responsive, in part, to the stylus transmitting a signal via alight transmitter.
 14. The method of claim 9, wherein said executing ofthe second different command comprises doing so responsive, in part, tothe stylus transmitting a signal via a infrared (IR) transmitter. 15.One or more computer-readable media having computer-readableinstructions thereon which, when executed by one or more processors on astylus-engagable, hand-held personal digital assistant having a touchscreen, cause the one or more processors to: display a selectable areaon the touch screen, said area being touch-selectable by a stylusassociated with the personal digital assistant; execute a first commandif only a stylus engages the selectable area; and execute a seconddifferent command if the stylus engages the selectable area and thestylus transmits a receivable signal to the personal digital assistant.16. A hand-held computing device comprising: a stylus comprising one ormore user-depressible buttons and a transmitter coupled with the one ormore buttons, the transmitter being configured to transmit a signal whena button is depressed; a stylus-engagable touch screen; one or moreprocessors; one or more computer-readable media; an association embodiedon the readable media, the association defining relationships betweenone or more input commands and a combination of user-input activitiesassociated with individual input commands; and computer-readableinstructions on the readable media which, when executed by the one ormore processors, cause the one or more processors to: display aselectable area on the touch screen, said selectable area beingtouch-selectable by the stylus; execute a first command if the stylusengages the selectable area; and execute a second different command ifthe stylus engages the selectable area and the stylus transmits areceivable signal responsive to a user depressing at least one of theuser-depressible buttons.
 17. The hand-held computing device of claim 16embodied as a personal digital assistant.
 18. The hand-held computingdevice of claim 16, wherein the computer-readable instructions cause theone or more processors to execute a second different command responsive,in part, to the stylus transmitting a bluetooth signal.
 19. Thehand-held computing device of claim 16, wherein the computer-readableinstructions cause the one or more processors to execute a seconddifferent command responsive, in part, to the stylus transmitting aradio frequency (RF) signal.
 20. The hand-held computing device of claim16, wherein the computer-readable instructions cause the one or moreprocessors to execute a second different command responsive, in part, tothe stylus transmitting a light signal.
 21. The hand-held computingdevice of claim 16, wherein the computer-readable instructions cause theone or more processors to execute a second different command responsive,in part, to the stylus transmitting a infrared (IR) signal.